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Abstract 


Reading  texts  for  the  purpose  of  making  decisions  was  studied  in  a 
laboratory  analogue  of  a  complex,  natural,  information-analytic  domain. 
Subjects,  acting  as  stock  brokers  were  trained  in  the  first  two  sessions  to 
categorize  and  evaluate  stock  report-type  information.  In  addition,  they 
learned  to  infer  information  from  text-explicit  facts.  In  Session  three, 
subjects  read  texts  and  made  decisions  to  Buy  or  Not  Buy  based  on  a  eonjuntive 
rule  that  was  either  given  to  the  subject  before  (RB)  or  after  (RA)  reading 
the  text.  In  Session  A,  subjects  read  texts  and  then  were  presented  probes 
that  were  to  be  verified  as  to  either  having  or  not  having  been  presented  in 
the  previously  read  texts.  Performance  in  all  tasks  was  measured  in  terms  of 
response  latency,  as  well  as  accuracy.  The  results  demonstrated  that  a 
specialized  control  schema  for  text  comprehension  develops  that  is  based  on 
the  nature  of  the  decision  task.  For  example,  readers  in  the  RA  versus  the  RB 
condition  develop  different  text  analysis  techniques  that  are  apparent  in  the 
decision,  as  well  as  the  verification  task  performance.  Most  of  the  results 
are  interpretable  in  terms  of  a  model  which  suggests  that  purposes  and  goals 
relevant  to  the  text  comprehension  process  are  incorporated  into  long-term 
memory  (i.e.,  knowledge  structures).  The  Integration  of  these  knowledge 
structures  with  current  short-term  information  provides  the  basis  of  a 
task-appropriate  text  representation. 


Understanding  and  remembering  information  for  the  purpose  of  making  a 
decision  involves  a  complex  set  of  mental  operations.  The  concept  of  schema 
is  useful  in  interpreting  these  operations.  A  schema  is  the  coherent  mental 
representation  of  interrelated  knowledge,  skills,  and  intentions  that  guides 
the  processing  and  utilization  of  any  pertinent  incoming  information 
(Rumelhart  and  Ortony,  1977).  Kozminsky,  Bourne,  Kintsch  (in  press)  have 
developed  a  model  for  analytic  information  processing  in  which  schema  is  a 
central  concept.  In  their  model,  schema  is  said  to  consist  of  ". . .declaritive 
and  procedural  information  that  can  act,  guide,  or  modify  the  information  flow 
in  a  cognitive  system."  Of  particular  concern  in  the  present  study  is  how  a 
schema  operates  to  affect  the  comprehension  of  information  presented  in  fairly 
complex,  information  rich,  technical  texts,  and  controls  decisions  to  be  based 
on  those  texts. 

Our  approach  in  the  present  study  is  to  isolate  and  emphasize  a  single 
salient  characteristic  of  the  schema,  viz.,  its  control  and  specification 
during  reading  of  what  aspects  of  the  text  are  relevant.  Theoretically,  this 
mechanism  rejects  irrelevant  information,  allowing  a  semantic  representation 
of  the  text  to  be  constructed  that  is  appropriate  for  subsequent  decisions  to 
be  made.  It  is  the  central  goal  of  this  study  to  determine  how  several 
factors  common  to  decision  making  in  technical  texts  guide  the  development  and 
use  of  schemata  as  control  devices  that  allow  a  sharpening  of  the  distinction 
between  what  is  relevant  and  irrelevant. 

The  experiments  presented  here  examine  the  effects  of  training,  task 
experience,  memory  and  type  of  decision  task  on  subject’s  sampling  procedures 
and  on  the  ability  of  subjects  to  attend  to  relevant  and  disregard  irrelevant 
information  in  texts.  We  are  interested  in  the  effects  of  these  variables  in 


Page  3 


complex  and  (quasi)  natural  domains.  For  this  purpose,  we  have  developed  a 
stock  market  environment  in  which  various  tasks  for  subject-analysts  can  be 
embedded.  The  stock  market  was  selected  because  it  appears  to  be  fairly 
typical  of  a  wide  range  of  interesting,  high  level  decision  making  domains, 
including  intelligence  analysis  in  the  military,  data  analysis  by  research 
scientists,  medical  diagnosis,  and  possibly  analysis  of  facts  in  criminal 
investigation  (Kozminsky,  et  al.,  in  press). 

The  first  step  in  establishing  a  control  schema  for  analysis  of  stock 
market  reports  was  to  teach  the  experimental  participant  to  categorize  and 
evaluate  single  statements  that  might  appear  in  such  a  report.  Subjects  were 
trained  to  interpret  statements  as  falling  into  one  of  six  fundamental 
information  categories  regarding  any  business:  Sales,  Earnings,  Growth, 
Capitalization,  Dividends  or  General  Factors.  They  also  learned  to  evaluate 
the  degree  to  which  a  statement  was  positive  or  negative  within  a  given 
category.  Training  was  intended  to  build  a  schema  for  reading,  comprehending 
and  analyzing  stock  reports.  Structurally,  the  schema  has  six  slots 
corresponding  to  six  informational  categories,  each  of  which  has  a  potential 
evaluative  valence.  The  slots  can  be  thought  of  as  requests  for  pertinent 
evaluative  information.  Furthermore,  the  schema  operates  with  two  basic 
processes,  categorization  and  evaluation  of  any  particular  input  statement. 
One  purpose  of  reading  a  specific  text,  then,  is  to  fill  each  slot  with  the 
appropriate  qualitative  and  evaluative  data. 

When  this  schema  driven  text  analysis  becomes  efficient,  the  trainee  has 
no  need  to  include  in  his  textual  representation  any  information  irrelevant  to 
his  purpose.  Thus,  it  is  of  little  consequence  to  the  comprehender  what 
particular  product  caused  Sales  or  Earnings  to  explode.  It  is  conceivably 
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irrelevant  for  some  purposes  to  know  why  a  company  lias  bad  credit  as  long  .is 
it  is  understood  that  Capitalization  is  weak  as  a  result.  it  is  assumed  that 
the  processes  of  categorization  and  evaluation  are  fundamental,  occurring  in  a 
wide*  range  of  comprehension  tasks  which  lead  to  decisions,  that  they  are 
intimately  involved  in  the  development  of  task-specific  schemata  and  are  a 
basis  for  distinguishing  relevant  from  irrelevant  information.  The  control 
schema  is  applied  to  arrive  at  decisions  (Ko/.minsky,  eL  al.,  in  press).  In 
the  process,  schema  knowledge  is  often  used  to  make  inferences  about 
information  that  might  not  be  presented  in  a  given  text.  If  a  report 
indicates  that  "Sales  are  outstanding"  hut  contains  no  statement  about 
Earnings,  the  subject  might  infer,  on  the  basis  of  what  he  knows  about  the 
relationship  between  Sales  and  Earnings  that  Earnings  are  also  likely  to  be 
excellent.  Correspondingly,  if  the  report  says  nothing  about  Dividends  but 
indicates  that  the  capital  iaztion  of  the  company  lias  improved  substantially, 
the  subject  might  infer  that  Dividends  were  probably  not  high. 

In  order  to  examine  these  inferential  processes,  participants  were 
instructed  and  trained  to  treat  certain  pairs  of  categories  as  perfectly 
correlated.  Two  experimental  tasks,  a  completion  task  and  a  verification 
task,  were  used  as  a  part  of  the  training  purposes.  The  completion  task 
presented  the  subject  with  sets  of  fundamentals  and  cor  responding  valences, 
with  the  valence  of  one  of  the  fundamentals  missing.  The  subject  was  to  infer 
the  missing  valence,  if  possible,  from  existing  information  about  the  others. 
In  the  verification  procedure  the  subject  was  to  check  the  set  of 
category-valence  pairs  for  consistency  with  the  predefined  correlational 
structure  of  categories. 


Categories , 


valences  and  correlations  and  the 


cognitive  skills  to 


generate  them  from  text  are  represented  in  the  general  schema  which  training 
was  intended  to  develop  in  all  subjects.  But  particular  decision  tasks  to 
which  the  schema  can  be  applied  require  only  a  simplified  version  of  the 
schema.  The  same  general  schema  then  becomes  tailored  to  suit  the  needs  of 
the  specific  task.  In  the  general  or  default  schema,  all  trained 
categorizations,  evaluations,  and  correlations  are  executable.  .Vs  the  subject 
gains  experience  in  any  specific  task,  a  sub  schema  develops  that  should 
reduce  search  time  and  increase  arcruacv  to  the  extent  permitted  by  the  task 
demands.  This  task  specific  schema,  a  degenerate  from  the  general  schema, 
will  guide  search  and  the  extent  to  which  category  and  evaluative  information 
is  processed.  Adjustments  to  that  schema  made  as  a  function  of  decision-task 
specifications  produce  a  more  specific  controi  schema.  The  major  control  on 
execution  should  be  in  terms  of  what  is  considered  relevant.  This  can  be 
realized  by  a  complete  cessation  of  processing  when  the  criterion  for  decision 
is  reached  (e.g.,  self-termi nating  search)  or  reduced  level  of  processing  of  a 
particualr  statement  when  it  is  realized  that  the  statement  is  not  relevant  to 
the  current  needs  of  Lhe  decision  rule.  If  these  processing  adjustments  are 
governed  by  a  control  schema,  they  will  be  evident  in  accuracy  and/or  RT 
measures . 

fn  the  study  by  Kozminskv,  et  al. ,  (in  press),  subjects  acted  as  stock 
brokers  in  a  task  which  required  them  to  discover  .1  certain  conjunctive 
decision  rule  for  predicting  performance  of  a  fictitious  stock.  Subjects  read 
specially  designed  stock  reports  and  had  to  learn,  by  feedback  on  their 
decisions,  which  two  categories  were  relevant  to  making  a  correct  decision. 
The  task  was  to  identify  the  relevant  categories  of  information  and  to  acquire 
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a  decision  rule  based  on  llmse  categories.  In  the  present  study  the  knowledge 
of  what  is  relevant  is  given  to  subjects.  That  is,  they  are  given  the 
decision  rule  that  specifies  the  categories  to  be  considered  for  a  correct 
response.  Whereas  Kosminsky,  et  al.  were  interested  in  rule  acquisition,  the 
present  study  is  interested  in  rule  usage.  The  present  study  was  aimed  at 
understanding  how  the  general  schema  Is  specialized  to  control  text  processing 
as  a  function  of  knowing  what  specific:  categorical  information  is  needed  to 
satisfy  a  decision  rule. 

One  question  of  major  interest  is  how  processing  is  controlled  depending 
upon  whether  a  person  is  provided  with  a  decision  rule  prior  to  or  after 
reading  a  text  that  contains  information  pertinent  to  that  decision.  Subjects 
make  decisions  ns  to  whether  or  not  they  should  buy  the  stock  of  a  fictitious 
company.  Decisions  are  to  be  based  upon  "quarterly  reports”  which  provide 
explicit  information  on  three  of  the  six  "fundamentals"  of  the  company’s 
recent  activities.  The  decision  rule  on  any  give  trial  joins  two  different 
fundamentals  which  need  to  be  positive  for  a  Buy  decision.  If  the  text 
provides  negative1  information  on  one  or  both  of  the  specified  fundamentals, 
the  correct  decision  is  "Not  Buy".  In  the  Rule  Before  (RB)  condition, 
participants  are  given  the  conjoint  rule  before  reading  the  text,  and  in  the 
Rule  After  (RA)  condition  the  rule  is  given  only  after  the  text  has  been  read. 

It  is  expected  that  participants  in  the  RB  group  will  incorporate  the 
decision  rule  into  their  task  specific  control  schema  and  deeply  process  only 
those  parts  of  the  text  that  are  relevant  to  the  rule.  Participants  in  the  RA 
condition  will  be  more  likely  to  process  the  text  completely.  Their  control 
schema  will  be  based  more  generally  on  their  training  in  earlier  sessions 
(i.e. ,  categorization,  evaluation,  and  correlation)  and  not  further  specified 
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by  a  particular  decision  rule.  One  expected  consequence  of  this  difference  in 
processing  is  that  the  benefit  engendered  by  a  self-terminating  search  in  a 
"Not  Buy"  text  should  be  greater  for  the  RB  than  for  the  RA  condition.  The  RA 
group,  while  it  can  terminate  its  search  as  in  the  RB  condition,  has  processed 
other  statements  in  the  text  and  those  statements  could  influence  the 
decision.  There  is  also  some  evidence  to  suggest  that  configural  properties 
of  the  text  will  be  more  influential  in  the  RA  condition  (Hayes-Roth  and 
Walker,  1979). 

Though  the  above  perdicts  that  the  RA  group  will  be  less  able  to  take 
full  advantage  of  the  processing  reduction  usually  created  by  self-terminating 
searches,  it  is  expected  that  they  may  enjoy  other  benefits.  There  is  some 
evidence  to  the  effect  that  inferences  are  made  efficiently  and  probably  more 
accuarately  on  the  basis  of  information  that  resides  in  memory  than 
information  that  is  perceptually  available  (Hayes-Roth  and  Walker,  1979). 
That  is,  when  a  subject  is  well-trained  in  the  tasks  to  be  performed,  knows 
the  kinds  of  reports  that  are  going  to  be  read,  has  a  control  structure, 
realizes  that  certain  decisions  are  going  to  be  required,  but  has  no  specific 
decision  rules,  then  that  subject  is  likely  to  make  all  allowable  inferences 
while  reading  the  report.  In  contrast,  when  the  subject  has  an  explicit 
decision  rule  at  the  outset,  the  report  can  be  read  without  necessarily  making 
any  inferences  at  all  (when  all  information  required  by  the  decision  is 
explicit  in  the  text).  So,  when  a  decision  does  require  inferences,  we  might 
expect  better  performance  in  decision  making  in  the  RA  in  contrast  to  the  RB 
condition.  This  is  one  of  the  basic  hypotheses  to  be  examined  in  the  present 


experiment 
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As  a  final  task  in  this  experiment,  we  use  a  verification  procedure  to 
examine  the  way  in  which  a  schema  determines  how  texts  are  processed  and 
stored  in  memory.  In  the  verification  task,  subjects  are  asked  to  indicate 
whether  a  target  statement  as  true  or  false  in  light  of  information  contained 
in  a  just-read  text.  These  texts  contain,  in  some  cases,  both  members  of  a 
correlated  pair.  Probes  can  either  be  inside  or  outside  the  pair.  We  expect 
to  find  inside  probes  to  be  verified  more  accurately  and  possibly  faster  than 
outside  probes.  This  prediction  is  based  on  the  assumption  that  correlated 
categories  will  augment  each  other  when  the  related  categorical  statements  are 
read.  It  is  assumed  that  verification  performance  on  one  of  these  categories 
will  benefit  by  the  fact  that  the  other  one  was  also  in  the  text.  This 
benefit  is  only  expected  to  occur,  of  course,  if  the  possible  inferences  are 
made  when  the  text  Is  read.  It  is  also  predicted  in  this  verification  task 
that  the  above  mentioned  benefit  should  be  greater  for  subjects  who  were  in 
the  RA  condition  than  for  those  who  were  in  the  RB  condition  of  the  decision 
task.  The  task-adjusted  specialized  schema  developed  during  the  decision  task 
will  be  continued  to  some  extent  when  sub jet. ts  are  placed  in  a  new  task.  As 
mentioned  above,  subjects  in  the  RA  condition  are  likely  to  process  the  text 
as  completely  as  their  general  schema  will  allow,  making  all  possible 
Inferences.  The  RB  group  learned  to  more  or  less  make  only  those  inferences 
dictated  by  the  predefined  decision  rule.  The  RA  group  will  be  more  likely  to 
make  the  inferences  necessary  to  allow  them  to  benefit  from  relationships 
between  pairs. 
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Method 

Subjects. 

Thirty  undergraduate  college  students  participated  as  subjects  in  he 
experiment  for  four  one-hour  sessions  each.  They  were  paid  $12.00  for  their 
time,  plus  a  $3.00  bonus  ostensibly  based  on  the  quality  of  their  performance 
in  tlie  experiment  (actually  all  the  subjects  received  this  bonus). 

Materials  and  Apparatus. 

Subjects  read  short  texts,  variable  in  length.  Mean  text  length  was 
47.26  words  and  the  texts  range  from  24  words  to  98  words  in  length.  Each 
text  contained  information  relevent  to  three  out  of  six  "fundamentals",  viz.. 
General  Factors,  Capitalization,  Growth,  Sales,  Earnings,  and  Dividends  of  a 
fictitous  company,  EXTEC.  The  three  information  categories  in  each  text  were 
selected  according  to  a  predetermined  sampling. 

A  pool  of  240  sentences,  40  sentences  for  each  of  the  six  information 
categories,  was  available  for  sampling.  These  sentences  were  pre-evaluated  on 
a  5-point  scale  from  1  (negative)  to  5  (positive)  information  about  a  category 
(see  Kozminsky,  Bourne,  and  Kintsch,  (1979)),  so  that  in  each  category  eight 
sentences  represented  one  of  the  five  possible  scale  values.  Eighteen 
additional  sentences,  three  sentences  per  information  category,  were  used  in  a 
practice  period. 


The  experiment  was 

controlled  by  the 

Sigma  3  computer 

housed 

in 

the 

computer  laboratory 

for 

Inst  ruction 

in  Psychological 

Research 

in 

the 

Department  of  Psychology, 

University  of 

Colorado.  The 

instructions 

and 

material  were  presented  on  CRTs  and  responses  were  made  on  a  five  button  panel 
interfaced  with  the  computer. 
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Procedure. 

The  experiment  consisted  of  four  sessions  spaced  over  four  consecutive 
days.  Each  session  lasted  about  .in  hour.  The  first  two  sessions  were 
training  sessions:  sentence  training  and  report  training.  The  last  two 
sessions  will  be  referred  to  as  the  decision  and  the  value  verification  tasks. 
Training. 

During  the  sentence  training  session,  a  subject  went  through  the 
following  sequence: 

(a)  The  general  nature  of  the  experiment  was  explained.  The  subjects 
were  told  that  they  would  perform  various  decision  and  verification  tasks  with 
stock  reports.  Initially  they  were  trained  to  read  and  evaluate  the 
information  in  such  reports  in  order  to  maximize  performance  efficiency  in  the 
later  tasks.  A  detailed  description  of  the  six  information  categories  was 
given.  (A  printed  version  of  this  description  was  in  front  of  the  subject  for 
reference  throughout  the  session. ) 

(b)  Eighteen  practice  sentences  were  displayed  one  at  a  time  and  the 
subject  learned,  with  feedback,  to  assign  sentences  to  their  corresponding 
categories.  In  a  second  pass  with  the  same  18  sentences  the  subject  evaluated 
the  information  in  each  sentence  on  the  5-point  scale,  again,  with  feedback. 

(c.)  The  nature  of  decision  rules,  conjunctions,  to  be  used  in  the 
decision  task  was  explained  and  demonstrated  with  three  tests  constructed  out 
of  the  18  practice  sentences.  In  addition,  a  background  description  of  the 
fictitious  company  KCKOL  was  presented  and  followed  by  a  short  comprehension 
test.  While  in  the  first  session  subjects  were  primarily  trained  to  identify 
and  evaluate  individual  sentences,  the  emphasis  In  the  second  report  training 
session  shifted  to  the  learning  of  the  report  structure  to  be  used  in  the  last 
two  sessions  and  to  the  relations  among  report  categories.  The  sentence 
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evaluation  scale  was  divided  into  two  zones:  a  positive  zone  consisting  of 
the  values  4  and  5  on  the  5-point  scale  and  a  negative  zone  consisting  of  the 
values  1,  2,  and  3. 

The  subjects  were  told  that  two  categories,  Sales  and  Earning6  were 
positively  correlated,  so  that  whenever  a  sentence  value  in  one  category  falls 
into  the  positive  zone  the  sentence  value  of  the  second  category  will  fall 
into  the  same,  positive  zone.  If  the  value  of  a  sentence  in  one  category 
falls  into  the  negative  zone  so  was  the  sentence  value  in  the  second  category. 
Another  pair  of  categories,  Growth  and  Dividends,  was  defined  to  be  negatively 
correlated.  A  positive  zone  value  in  one  category  entailed  a  negative  zone 
value  in  the  second  category.  All  other  category  pairings  were  uncorrelated. 

The  correlation  concept  was  carefully  explained  and  illustrated  with 
examples.  A  "commonsense"  explanation  for  the  particular  correlation  used  was 
given:  Sales  produce  profit  and  if  Earnings  are  good,  one  can  expect  Sales  to 
be  good.  Similarly,  when  money  goes  into  Growth,  the  company  has  less  money 
to  pay  Dividends,  and  when  the  company  pays  a  large  amount  of  Dividends  there 
is  less  money  to  invest  in  Growth.  A  typed  table  describing  the  correlation 
among  the  categories  was  in  front  of  the  subject  for  reference  during  this 
session. 

Subjects  were  given  two  kinds  of  experience  with  the  correlation  concept. 
In  a  completion  task,  they  had  to  infer  missing  category  values.  In  a 
verification  task,  reports  were  tested  for  consistency.  Reports  were  not 
written  out  in  paragraphs  (text  form),  but  rather  were  given  in  the  form  of 
tables.  Each  table  presented  the  category  labels  and  their  associated  values. 
In  the  completion  task  a  report  consisting  of  three,  four,  or  five  categories 
was  presented  in  which  one  of  the  category  values  was  missing.  The  subject’s 
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task  was  to  determine  the  value  of  the  missing  category.  For  example,  a 
presented  report  was  "Earnings  -  3,  Capitalization  -  1,  Sale  -  ?."  The 
subject's  task  was  to  infer  from  his  knowledge  about  the  correlation  between 
Earnings  and  Sales  that  Sales  value  was  negative.  There  were  three  d  sible 
responses:  the  inferred  category  value  was  in  the  positive  zone,  the  negative 
zone,  or  could  not  be  inferred.  An  example  of  a  report  that  elicited  the  last 
response  was  "Capitalization  -  3,  Sales  -  5,  General  Factors  -  3,  Earnings  - 
4,  Growth  -  ?."  Since  no  information  was  given  on  Dividends,  the  Growth  value 
could  not  be  inferred.  Three  response  buttons  from  left  to  right  were 
designated  as  (negative  zone  value),  "insufficient  information,"  and  "+" 
(positive  zone  value).  The  report  categories  were  presented  below  each  other 
on  th  screen  in  a  random  order  except  that  the  last  category  in  the  report 
contained  the  missing  value.  Following  each  response,  feedback  was  given  as 
to  whether  the  subject  was  correct  or  wrong  and  as  to  what  the  correct 
response  should  be. 

In  the  verification  task  the  subject  was  presented  with  a  report 
structure  similar  to  that  in  the  completion  task  but  no  cateogry  value  was 
missing.  The  report,  again,  consisted  of  three,  four,  or  five  categories,  and 
their  values.  In  this  task,  however,  the  subject  was  asked  whether  the 
presented  report  conformed  to  the  ccrrelation  structure  he  was  told  about. 
There  were  three  response  options:  consistent,  inconsistent  and  not 
inconsistent.  An  inconsistent  report  was  defined  as  one  that  contained  at 
least  one  correlated  category  pair,  but  the  category  values  did  not  conform  to 
the  correlation  defined  between  the  categories,  e.g.,  "Growth  -  5,  General 
Factors  -  4,  Dividends  -  4.”  A  consistent  report  contained  at  least  one 
correlated  category  pair  with  values  acording  to  the  correlation  pattern.  For 
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example,  "Earnings  -  3,  (.'eneral  Factors  -  2,  Capitalization  -  3,  Sales  -  2." 
The  remaining  case,  not  inconsistent  reports,  contained  at  least  one  catelgory 
from  a  correlated  pair  whoes  counterpart  was  missing  from  the  report.  In  the 
report  "Dividends  -  4,  Capitalization  -  3,  Earnings  -  2,  Sales  -  1,  General 
Factors  -  3,"  the  Growth  category  was  missing.  (This  case  could  be  thought  of 
as  a  consistent  report  with  one  correlated  category  missing. )  The  subject  was 
told  that  since  at  least  one  correlated  category  was  missing  there  is  not 
enough  information  to  determine  whether  the  report  was  consistent  or 
inconsistent.  The  inclusion  of  this  case  in  the  task,  forced  the  subject  to 
test  both  for  consistency  and  inconsistency  of  the  presented  reports. 
Following  each  response,  feedback  was  given  as  to  whether  the  subject  was 
correct  or  wrong  and  as  to  what  the  correct  responses  should  be. 

There  were  three  trial  blocks  consisting  of  18  completion  and  18 
verification  trials  each,  a  total  of  36  trials  in  a  block.  Of  the  18  trials, 
six  contained  three  categories  in  a  report,  six  contained  four  categories  and 
six  contained  five  categories  in  each  sub  task.  For  a  six-trial  set  in  the 
completion  task,  two  trials  resulted  in  a  positive  response,  two  in  a  negative 
response,  and  two  with  an  "insufficient  information”  response.  Similarly,  in 
the  verification  task,  there  were  two  consistent,  two  inconsistent,  and  two 
not-inconsistent  trials.  The  number  of  positively  and  negatively  correlated 
category  pairs  were  counterbalanced  in  each  6-trial  set.  In  each  36-trials 
block,  the  completion  task  was  presented  first,  preceded  by  a  message  to  this 
effect,  and  was  followed  by  the  18  trials  of  the  verification  task,  again, 
with  a  preceding  message  notifying  the  subject  that  the  verification  task  was 
following.  Withing  each  18-trial  set,  trials  were  randomly  presented  and  so 
were  the  three  blocks.  The  performance  emphasis  in  these  tasks  was  both 
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accuracy  and  speed  of  response.  Subjects  were  told  to  make  their  decisions 
carefully,  considering  all  the  available  information. 

Decision  task. 

In  the  third  session  subjects  were  asked  to  read  a  short  stock  report  and 
apply  a  conjuctinve  decision  rule  in  order  to  decide  whether  to  buy  the  stock, 
not  to  buy  it,  or  respond  that  there  was  not  sufficient  information  in  the 
report  to  give  either  one  of  the  first  two  recommendations.  Following  each 
decision,  feedback  was  given  on  the  correctness  of  the  decision.  There  were 
45  such  trials.  Subjects  were  asigned  to  one  of  two  groups,  15  subjects  in  a 
group.  One  group.  Rule  Before  Group,  received  the  decsion  rule  prior  to 
reading  the  text.  The  second  group.  Rule  After  Group,  received  the  rule  after 
reading  the  text.  Rule  inspection,  text  reading,  and  decision  were 
self-paced. 

The  45  texts  were  divided  into  five  blocks,  nine  texts  in  a  block, 
randomly  sequenced  for  each  subject.  The  five  blocks  were  equivalent  in  their 
design.  A  design  confiuration  for  one  block  is  given  in  Table  1.  In  the 
first  trial,  sentences  (and  values)  from  the  Earnings  (positive).  Growth 
(negative)  and  General  FActors  (positive)  categories  were  presented  in  a  text 
format  in  a  random  order.  The  decision  rule  was  based  on  two  explicit 
categories  in  the  text  -  -  Earnings  and  General  Factors.  The  expected  correct 
decision  was  to  buy  the  stock  since  the  two  values  of  the  relevant  categories 
were  positive.  In  Trial  2  Sales  (positive).  Dividends  (positive),  and 
Capitalization  (negative)  sentences  were  assembled  and  presented  in  a  text. 
The  decision  rule  in  this  trial  was  based  on  Earnings  and  Dividends.  Earnings 
information  was  not  given  in  the  text  so  its  value  had  to  be  inferred  from 
reading  the  Sales  sentence.  The  other  rule  category  was  explicit  in  the  text. 
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The  first  three  trials  in  the  block  example  resulted  in  a  buy  decision.  Trial 
1  rule  was  based  on  two  categories  explicit  in  the  text;  on  Trial  2,  one 
category  was  explicity  in  the  text  and  one  implicit;  on  Trial  3,  the  two  rule 
categories  were  implicit.  Trials  3-6  resulted  in  a  no  buy  decision  with  rule 
category  types  corresponding  to  Trials  1-3.  The  last  three  trials  consisted 
of  texts  and  decision  rules  with  "insufficient  information  to  make  a 
decision”.  On  Trial  7  the  two  rule  categories  were  missing  in  the  text  and 
could  not  be  inferred;  on  trial  8  one  category  was  explicit  in  the  text;  and 
on  Trial  9  one  category  could  have  been  inferred.  The  other  four  blocks  were 
equivalent  in  their  design  to  the  one  described  above,  except  that  the 
particular  categories  used  and  the  decision  rule  varied. 


Insert  Table  1  about  Here 


The  frequency  of  categories  and  their  sign  values  in  the  texts  were 
controlled  over  the  five  blocks.  In  each  block  a  category  appeared  in  the 
texts  four  or  five  times.  About  half  of  the  category  sign  values  were 
positive  and  half  were  negative.  Each  category  appeared  three  times  in  the 
desion  rule  in  each  block.  Texts  were  assembled  from  the  sentence  pool 
individually  for  each  subject  pair  (se  Materials  section),  so  that  one  subject 
from  the  Rule  before  Group  and  one  from  the  Rule  after  Group  received 
identical  texts.  For  example,  a  text  constructed  for  Trial  2  in  Table  1 
consisted  of  a  Sales  sentence  valued  4  or  5,  a  Dividends  sentence  similarly 
valued,  and  a  Capitalization  sentence  valued  1,  2,  or  3.  The  order  of  these 
sentences  in  the  text  was  random.  Table  2  provides  a  text  sample  for  Trial  2 
in  Table  1. 


Page  16 


Insert  Table  2  about  Here 


Value  Verification  Task. 

On  the  fourth  session  the  subject  read  a  short  text  (self-paced).  After 
reading  the  text,  a  category  and  a  value  (plus  or  minus)]  appeared  on  the 
screen  and  the  subject  was  asked  to  verify  whether  the  category’s  value  that 
appeared  in  the  probe  matched  that  in  the  text.  Feedback  on  accui  followed 
each  response.  In  a  second  task  following  the  feedback,  the  subject  was  asked 
to  verify  if  a  category  drawn  randomly  out  of  the  list  of  the  six  categories 
was  mentioned  in  the  text  or  not.  No  feedback  was  given  after  this 
verification.  No  data  was  collected  on  this  second  task.  It  was  used  merely 
to  insure  that  the  subject  processed  all  the  category  input  and  not  just  the 
odd-signed  category. 

There  were  48  trials  of  this  kind  divided  into  four  blocks  of  12  trials 
each,  equivalent  in  their  general  desgin.  A  design  block  exmple  Is  given  in 
Table  3.  As  a  example,  on  Trial  1  the  text  consisted  of  sentences  from  the 
Sales,  Earnings,  and  Capitaliztion  categories  with  negative,  negative,  and 
positive  values,  respectively.  The  cateogry  to  be  verified  was  Sales 
(circled)  with  a  negative  sign,  so  the  correct  response  was  "true"  to  this 
probe. 


Insert  Table  3  about  here 
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Two  variables  were  counterbalanced  within  each  block:  the  expected 
correct  reponses  and  trial  type.  Three  types  of  text  were  used:  Consistent 
texts  consisted  of  two  correlated  categories  with  signs  corresponding  to  the 
defined  correlations  and  one  uncorrelated  category:  inconsistent  texts  in 
which  the  sentence  signs  of  a  correlated  pair  were  not  in  accordance  with 
their  predefined  correlation;  and  not  inconsistnet  tests  in  which  only  one 
sentence  of  a  correlated  pair  was  allowed  in  the  text.  Several  other 
variables  were  controlled  in  each  block.  Each  category  appeared  six  times 
over  the  12  trials  in  each  block;  a  category  was  probed  twice  in  each  block, 
and  there  were  six  category  probes  with  a  positive  sign  and  six  with  a 
negative  sign. 

After  completing  this  task,  subjects  received  a  questionnaire  in  which 
they  described  their  general  approach  to  the  task  and  provided  some  personal 
backgroud  information. 

Results 

Training.  Response  accuracy  and  latency  were  measured  in  both  the 
categorization  and  evaluation  task.  There  were  no  significant  differences 
between  the  Rule  Before  and  the  Rule  After  condition,  _t  <  1.0,  in  either  task. 
The  average  percent  correct  out  of  18  trials  of  categorization  was  76%,  the 
average  latency  was  21.0  seconds.  The  corresponding  accruacy  and  time  for  the 
evalutation  task  were  56%  and  9.3  seconds.  Thus  the  two  groups  of  subjects 
used  for  RB  and  RA  conditions  in  later  sessions  performed  about  equally  in 
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The  same  design  was  used  to  anlayze  the  accuracy  and  latency  measures  in 
both  the  completion  and  verification  analysis:  Group  x  Trial  Block  x  Number 
of  Categories  x  Response  Type.  This  design  yields  only  two  scores  per  cell. 
Consequently,  for  the  analysis  of  correct  RTs  there  were  some  empty  cells.  To 
handle  this  problem,  two  different  analyses  were  conducted,  one  removing 
subjects  with  empty  data  cells  and  the  other  collapsing  across  the  number  of 
categories  variable.  The  results  were  essentially  identical  in  both  analyses. 

Table  4  shows  the  main  affects  and  corresponding  F-scores.  Groups  RA  and 
RB  did  not  differ  either  in  percent  correct  or  latency  in  either  the 
completion  or  verification  task.  This  is  expected  since  it  is  not  until 
Session  3  that  the  treatment  manipulation  for  groups  was  invoked.  The  main 
effect  for  trial  block  was  also  expected,  demonstrating  significant 
improvement  in  performance  with  practice.  There  is  no  significant  effect  of 
set  size,  the  number  of  categories  about  which  information  was  provided,  on 
accuracy  (see  Table  4).  However,  at  least  for  some  subjects,  increasing  the 
number  of  categories  increased  percent  correct  responses  slightly.  A  positive 
correlation  between  set  size  and  percent  correct  might  be  due  to  the  fact  that 
large  set  sizes  provide  more  complete  information  in  a  closed  task  domain. 
The  effect  of  set  size  on  latency  is  significant  in  both  the  completion  and 
verification  task.  The  more  information  presented  the  longer  the  response 
latency.  Finally,  the  main  effect  for  response  type  was  significant,  but  only 
for  latency  measures  and  the  verification  task.  The  fact  that  an  effect  of 
response  type  on  RT  was  found  only  for  the  verification  task  and  not  for  the 
completion  task  is  understandable  in  terms  of  processing  differences  between 
the  two  tasks.  First,  judging  by  percent  correct  and  latency  measures,  the 
verification  task  is  more  difficult  than  the  completion  task,  _F(l,  20)  *  68.4, 
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2  <  .00001.  The  verification  task,  as  mentioned  earlier,  requires  a  more 

complete  text  analysis  than  the  completion  task  does. 


Insert  Table  4  about  here 


It  was  predicted  that  subjects  would  develop  a  control  schema  for  these 
tasks  which  would  allow  reduced  processing  on  irrelevant  material.  Since  a 
greater  amount  of  material  was  made  Irrelevant  by  the  completion  task, 
subjects  responded  faster,  on  this  task.  In  the  completion  task  there  is  a 
set  of  categories  with  values  and  one  category  without.  The  subject  need  only 
examine  which  category  is  with  a  missing  value,  search.  for  its  correlated 
category,  and  compute  the  missing  value,  knowing  the  correlational  function. 
When  the  correlated  category  is  not  present,  an  exhaustive  search  of  the 
signed-categories  is  required.  This  search  model  predicts  that  set  size  would 
have  its  largest  effect  when  the  appropriate  response  is  "Insufficient 
Information".  This  prediction  is  substantiated  in  the  data  by  a  significant 
set  size  by  response  type  interaction,  F^(4,  80)  =  4.74,  _p  <  .002.  It  should 
also  be  noted,  however,  that  the  effect  of  response  type  on  RT  was  reduced 
with  practice  (Response  type  by  trial  block,  £(4,  72)  =  3.94,  £  <  .01). 

A  different  search  model  is  required  for  the  verification  task.  The 
subject  must  search  the  text  for  information  on  a  correlated  category  then 
that  category's  mate  must  be  found  and  value  relationship  between  the  two  must 
be  checked.  When  there  are  four  or  five  categories  present,  two  sets  of 
relations  might  have  to  be  investigated.  This  explains  why  responding  is  more 
accurate  and  faster  when  the  appropriate  response  is  "Inconsistent".  Only  one 
set  of  relationships  need  be  found.  For  "consistent"  or  "insufficient 
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Information"  response,  two  sets  might  have  to  be  dealt  with.  Further 
substantiation  of  this  reasoning  is  found  by  examining  the  interaction  of  set 
size  by  response  type,  jF(4,  80)  =  3.19,  _p  <  .02.  The  largest  effect  of  set 
size  on  verification  times  was  when  the  appropriate  response  was  "Consistent". 

The  important  things  to  remember  about  the  pattern  of  results  from  the 
training  tasks  (Session  1  and  Session  2)  is  that  it  is  consistent  with  task 
demand  models  and  that  Group  (RA  versus  RB)  is  not  involved  in  any  significant 
effects.  These  basic  results  support  the  notion  that  a  task-adjusted  control 
schema  develops  with  task  experience.  That  schema  controls  information 
processing  and  search  procedures.  Also,  the  lack  of  effects  for  the  RB/RA 
factor,  suggests  that  any  group  effects  that  arise  in  Session  3  and  4  are  most 
likely  attrubutable  to  treatment  conditions  imposed  in  Session  3. 

Decision.  The  Decision  task  yields  three  measures:  proportion  correct 
response  l P ( c) ]  and  two  reaction  time  measures  (RT1  and  RT2).  For  the  Rule 
Before  condition  (RB),  RT1  was  the  time  to  read  the  rule  and  RT2  was  the  time 
to  read  the  text  plus  make  a  decision.  For  the  Rule  After  condition  (RA),  RT1 
was  the  time  to  read  the  text  and  RT2  was  the  time  to  read  the  rule,  reflect 
on  the  text  and  make  a  decision.  These  RT  measures  are  obviously  not  directly 
comparable  because  a  particular  measure  contains  a  different  amount  of  reading 
in  each  condition.  Consequently,  RT1  and  RT2  were  analyzed  separately  for 
conditions  RB  and  RA.  Except  for  a  tendency  for  longer  RTs  for  reading  texts 
or  rules  that  contained  more  implicit  information,  however,  the  analyses  of 
RTs  showed  no  significant  or  interesting  differences.  The  lack  of  significant 
effects  in  RTs  is  likely  due  to  a  high  degree  of  response  variability  caused 
in  large  part  by  having  three  as  oppossed  to  two  possible  response  categories 
in  conjunction  with  the  complexity  of  the  decision.  In  any  case,  most  of  the 
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effects  of  Interest  obtained  in  the  accuracy  scores.  This  concentration  of 
treatment  variability  in  the  p(c)  measure  was  fortunate  in  that  it  allowed  a 
better  comparison  between  the  RB  and  RA  conditions,  since  as  mentioned  above 
the  crucial  RT  measures  for  the  two  groups  are  not  directly  comparable. 

Table  5  shows  the  mean  percent  correct  decisions  by  Response  Type  and 
Text  Type  for  each  condition.  Text  type  has  a  different  meaning  when  the 
response  Insufficient  Information  is  required  than  when  either  Buy  or  Not  Buy 
is  required.  Because  of  this  difference,  responses  to  text  containing 
insufficient  information  were  analyzed  separately.  Mean  proportion  correct 
responses  for  texts  with  missing  information  on  both  categories  specified  in 
the  conjoint  rule  was  .74.  When  information  on  one  category  was  present,  the 
mean  proportion  correct  responses  was  .48  if  that  category  was  given 
explicitly  and  .65  if  that  information  was  implicit,  £(2,  40)  =  9.9,  <  .005. 
Apparently,  when  only  one  piece  of  information  is  provided  for  a  conjoint 
rule,  decision  is  based  on  that  information  if  the  information  is  given 
explicitly  as  opposed  to  implicitly  in  the  text.  Thus  there  may  be 
differential  weightings  of  information  as  a  function  of  how  the  information  is 
obtained.  If  one  piece  of  relevant  information  is  text  explicit  there  is  a 
tendency  to  use  it  to  make  a  buy/not  buy  decision  rather  than  to  search  for 
the  other  piece  of  information  required  by  the  conjoint  rule.  All  other  main 
effects  and  interactions  with  respect  to  insufficient  information  responses 
were  not  significant. 


Insert  Table  5  about  here 
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Response  to  texts  requiring  HUY  and  NOT  BUY  decisions  were  analyzed 
together  since  the  Text  Type  variable  has  the  same  meaning  for  both  Response 
Types.  Mean  proportion  correct  responses  for  the  RB  group  was  .76  and  for  the 
RA  group  .70,  _K(  1  ,  20)  =  28.2,  <  .0001.  Accuracy  was  greater  when  the  text 
required  a  NOT  BUY  decision  than  when  a  BUY  decision  was  required.  Response 
type  also  interacted  with  condition,  _F(  1 ,  20)  =  6. 1 ,  £  <  .05.  The  difference 
for  Response  Types  was  smaller  for  the  RA  group  than  for  the  RB  group. 

This  interaction  reflects  the  fact  that  the  RA  group  did  not  show  as 
great  an  increase  in  percent  correct  in  the  NOT  BUY  condition  as  was  found  in 
the  RB  group.  Response  Type  also  interacted  with  Text  Type,  j^(2,  40),  < 
.001.  For  texts  requiring  BUY  responses,  accuracy  increased  as  a  function  of 
the  amount  of  explicit  information.  For  NOT  BUY  texts,  accuracy  was  largely 
unaffected  by  the  Text  type  variable.  This  possible  adjustment  in  control 
schema  that  produces  the  main  effect  for  Response  Type  can  be  understood  by 
the  nature  of  the  conjoint  decision  rule.  Both  the  main  effect  of  response 
type  and  the  interaction  of  response  type  with  condition  were  predicted.  It 
was  suggested  that  a  task-adjusted  control  schema  in  the  decision  task,  would 
result  in  a  self-terminating  search.  It  was  further  suggested  that  because  of 
the  RA  group  having  to  search  through  memory,  the  advantage  would  be  less  for 
them. 

Locating  one  piece  of  NOT  BUY  information  is  enough  to  support  a  NOT  BUY 
decision,  whereas  a  decision  to  BUY  needs  two  pieces  of  information.  The 
interaction  of  Response  Type  by  Condition  is  assumed  to  be  due  to  the  effect 
of  configural  text  properties  that  are  operational  when  the  information  to 
make  decisions  is  being  derived  from  memory  of  the  text.  One  possible  way 
this  might  operate  is  as  follow.  The  information  presented  in  a  sentence  is 
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categorized  and  memory  Is  searched  to  determine  if  that  category  is  relevant 
to  the  conjoint  decision  rule.  If  the  first  decision-relvant  text  category  Is 
negative,  the  appropriate  NOT  BUY  response  can  be  executed  without  any 
influence  of  the  second  decision-relevant  category  in  the  text.  In  RA 
processing,  the  rule  categories  are  read  and  searched  for  in  memory  by  the 
subject.  In  this  condition,  even  if  the  first  decision-relevant  text  category 
found  is  negative,  the  valence  of  the  other  decision  category  or  possible 
non-decision  categories  could  affect  the  decision.  Briefly  stated,  since  the 
RA  condition  forces  processing  of  the  whole  text  there  is  a  greater  chance  of 
positive  information  inhibiting  the  NOT  BUY  response. 

The  main  effect  for  Text  Type  was  significant,  F(2,  40)  =  4.8,  j>  <  .01: 
decision  accuracy  was  a  positive  function  of  amount  of  explicit  information. 
However,  as  the  above  Response  type  by  Text  type  Interaction  suggests,  the 
effect  is  evident  only  in  texts  requiring  BUY  decisions.  The  increase  in 
difficulty  with  more  implicit  categories  can  be  understood  in  the  following 
way.  When  the  text  contains  one  or  more  pieces  of  implicit  category 
information,  there  is  an  increased  chance  of  confusion  due  to  explicit  and 
impl ic: it  category  valences.  For  example,  assume  that  a  rule  requires  the 
decision  to  be  based  on  General  Factors  and  Growth.  Suppose  that  one 
decision-relevant  category  in  the  text  was  a  positive  statement  about  General 
Factors,  and  that  a  second  decision-relevant  category  found  in  the  text  was  a 
positive  statement  about  Dividends.  In  this  sort  of  situation  there  is  an 
incongruence  between  explicit  and  implicit  valences.  This  incongruence  occurs 
about  half  the  time  for  Text  Types  containing  one  implicit  category,  but 
always  occurs  when  there  are  two  implicit  categories.  Thus,  when  evidence 
exists  for  satisfaction  of  the  conjoint  rule,  differences  in  valence  of 
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explicit  and  implicit  categories  make  integration  of  the  true  information  more 
difficult.  Presumably,  such  an  integration  never  takes  place  for  a  NOT  BUY 
decision,  since  only  one  piece  of  information  is  necessary. 

An  analysis  was  performed  to  compare  proportion  correct  responses  for 
positive  versus  negative  inferences.  This  analysis  used  responses  only  to 
texts  containing  one  piece  of  implicit  information.  Positive  inferences  were 
more  accurate  than  negative  inferences,  _F(  1 ,  20)  =  4.62,  jp  <  .05.  There  was 
also  some  indication  though  not  statistically  reliable,  that  inference  type 
was  less  important  for  RA  than  for  the  RB  condition. 

Verification.  The  only  effect  to  reach  significance  in  verification 
latencies  was  the  main  effect  for  Response  Types.  "No"  responses  took  longer 
than  "Yes"  responses,  F_(  l ,  20)  =  9.7,  p  <  .01.  This  presumably  indicates  a 
more  exhaustive  memory  search  for  "No"  responses. 

For  the  initial  analysis  of  accuracy,  data  for  texts  that  had  no 
correlated  categories  present  were  excluded,  because  the  manipulation  of  probe 
type  has  no  meaning  in  this  case.  The  Condition  variable  that  divided 
subjects  into  two  groups  in  the  Decision  task  was  used  as  a  factor  in  the 
analysis  of  verification  data  in  order  to  assess  the  effects  of  differential 
pre-verification  experience.  Mean  proportion  correct  responses  for  the 
Condition  x  Text  consistency  x  Probe  type  x  Response  type  interaction  is  shown 
in  Table  6. 


Insert  Table  6  about  here 
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The  Probe  type  by  Condition  interaction  was  significant,  _K  ( l ,  20)  *  4. 4, 
j)  <  .05.  As  can  be  seen  in  Table  7.  Probe  type  made  a  difference  only  in  the 
RA  condition,  where  probing  evaluative  information  inside  a  correlated  pair 
produced  greater  accuracy  than  probing  outside. 


Insert  Table  7-10  about  here 


As  mentioned  earlier,  this  interaction  was  predicted  on  the  assumption  that 
subjects  would  carry  over  the  specialized  control  schemata  from  the  previous 
decision  task  in  Session  3.  In  the  decision  task,  RA  condition  subjects  did 
not  know  the  decision  rule  until  after  reading  the  text.  Consequently,  they 
were  forced  to  develop  a  control  schema  for  text  processing  which  had  them 
making  and  remembering  both  implicit  (inference)  and  explicit  information. 
Some  evidence  for  this  was  found  in  the  RT1  data,  which  showed  that  texts  with 
more  implicit  information  took  longer  to  process.  If  this  is  the  case, 
subjects  in  the  RA  condition  should  better  integrate  the  information  presented 
on  two  correlated  categories.  That  is,  if  positive  information  was  presented 
for  both  Sales  and  Earnings  in  the  same  text  and  the  probe  was  on  Sales, 
memory  for  the  Earnings  information  represents  another  path  to  the  required 
information  on  Sales.  Since  the  subjects  make  these  inferences  it  should  also 
be  true  that  they  recognize  when  the  value  relationship  between  the  correlated 
categories  is  incorrect  in  the  text.  The  counter-assumption  for  RB  condition 
subjects  is  that  they  learned  generally  only  to  make  those  inferences  that 
they  needed  for  collecting  evidence  on  a  rule.  The  verification  task  provided 
no  rules  so  that  RB  subjects  would  accordingly  primarily  process  the  texts  for 
explicit  information. 
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Table  8  shows  that  across  both  groups,  when  the  text  is  consistent, 
probing  inside  a  correlated  pair  yields  greater  accuracy  than  probing  outside, 
while  there  is  little  difference  for  probe  type  in  inconsistent  texts,  FO, 
20)  =  7.6,  £  <  .02.  Text  type  also  interacted  with  Response  type,  FQ,  20)  * 


14.4,  £  < 

.002. 

Table  9  shows  that 

performance  was  more 

accurate  on  YES 

responses 

for 

inconsistent  texts 

and  on  NO  responses  for 

consistent  texts. 

Across  treatment  groups,  probing  inside  correlated  pairs  produced  the  greatest 
benefit  when  the  text  was  consistent  with  the  correlations  known  by  the 
subject.  For  example,  asking  to  verify  that  Dividends  were  positive  would  be 
more  accurate  if  a  negative  rather  than  positive  statement  was  made  about 
Capitalization  in  the  text,  since  the  learned  correlation  between  these 
fundamentals  was  negative. 

The  verification  task  also  produced  the  3-way  interaction  shown  in  Table 
10.  probe  type  by  Response  type  by  Condition,  £(1,  20)  *  5.4,  £  <  .05.  The 
RB  group  shows  an  advantage  for  probing  inside  versus  outside  correlated  pairs 
for  YES  responses,  while  the  opposite  is  true  for  NO  responses.  For  the  RA 
group,  performance  was  always  better  when  the  probe  was  inside  correlated 
pairs  and  that  advantage  was  slightly  greater  for  NO  responses.  Previously 
discussed  data  from  this  experiment  have  substantiated  to  a  large  extent  that 
subjects  in  the  RA  condition,  in  carrying  over  their  task-adjusted  control 
schema  developed  during  the  Decision  task,  process  the  text  for  implicit 
information  more  thoroughly  than  RB  subjects.  Consequently,  it  is  not 
surprising  to  find  all  around  better  performance  on  inside  probes  for  RA 
subjects.  Those  probes,  whether  requiring  a  YES  or  NO  response,  tap  an  aspect 
of  the  text  these  subjects  took  into  account  while  reading  the  text.  The  case 
for  the  RB  subjects  is  different.  They  are  presumed  to  have  most  of  the 


Page  27 


information  stored  explicitly  so  correlated  fundamentals  are  not  well 
integrated  for  them.  It  might  be  further  assumed  that  there  is  a  slight  bias 
for  remembering  positive  as  opposed  to  negative  information  and/or  that 
searching  one's  memory  of  a  text  to  verify  a  probe  is  passed  primarily  on 
searching  for  confirming  as  opposed  to  infirming  evidence.  Consequently,  when 
the  text  is  inconsistent  and  the  probe  is  inside  a  correlated  pair,  subjects 
in  the  RB  group  are  going  to  do  poorly  when  a  negative  response  is  required. 

Assume  a  text  which  contains  a  positive  Sales  statement  and  a  negative 
Earnings  statement  and  the  probe  is  positive  Earnings.  If  the  above  rules  are 
In  operation,  subjects  would  search  their  memory  for  information  that  would 
support  positive  Earnings.  RB  subjects  should  be  well  practiced  at  making 
inferences  when  they  have  a  specific  goal  in  mind.  Consequently,  they  may 
find  a  positive  Sales  statement  sufficient  evidence  to  say  Yes,  Earnings  were 
positive.  This  predicts  a  very  low  accuracy  when  NO  responses  are  required 
for  inside  probes  on  inconsistent  texts.  Table  6  confirms  this  prediction, 
which  we  believe  to  be  the  primary  basis  for  the  above  mentioned  3-way 
interaction. 

Discussion 

The  experimental  tasks  reported  here  were  designed  to  provide  data 
relevant  to  the  processes  of  Information  analysis  and  decision  making  in 
texts.  It  is  a  major  thesis  of  this  study  that  understanding  schema 
development  and  application  will  aid  in  the  interpretation  of  these  processes. 
We  have  typified  the  structure  of  a  schema  as  a  set  of  requests  for  specific 
information.  A  "request  for”  something  is  like  knowledge  of  what  to  look  for, 
but  it  is  likely  that  a  schema  also  incorporates  "how  to”  knowledge.  That  is, 
what  set  of  operations  are  necessary  to  obtain  the  requested  information.  The 


structural  and  functional  characteristics  are  probably  never  static,  but  are 
developed  and  continually  evolve  through  an  ongoing  means-ends  analysis. 

During  training,  subjects  learned  to  analyze,  to  categorize  and  to 
evaluate  stock  reports.  Training  leaves  schemata  that  guide  the  use  of 
categorical  and  evaluative  information  in  specific  tasks.  Training  provided 
participants  with  heuristics  applicable  over  a  range  of  tasks.  These 
heuristics  Include  text  analysis  only  for  certain  relevant  pieces  of 
information  identified  by  task  demands.  In  addition,  participants  learned  to 
analyze  categorized  information  for  its  implied  as  well  as  its  explicit 
information.  Because  a  person  can  not  represent  all  aspects  of  the  text  after 
a  single  reading  time  the  means-ends  analysis  provides  a  method  for  selecting 
a  text  representation  that  has  the  greatest  relevance  for  current  purposes. 
After  a  reasonable  amount  of  training  it  is  assumed  that  the  schema  developed 
can  be  thought  of  as  well  formed  in  permanent  or  long-term  memory. 

As  new  task  environments  are  encountered  the  structural  and  functional 
characteristics  of  the  schema  continue  to  evolve.  We  examined  performance  in 
a  task  where  subjects  must  use  a  two  category  BUY/NOT  BUY  decision  rule.  If 
two  (specific)  fundamentals  are  positive,  the  correct  response  is  "BUY" 
otherwise  "NOT  BUY".  The  control  schema  operates  such  that  if  one  of  the 
specified  fundamentals  is  found  to  be  negative  a  "NOT  BUY”  response  is 
appropriate  without  further  consideration  of  other  text  information.  As  a 
consequence,  we  expect  and  we  found  better  performance  levels  for  ''Not  Buy” 
than  for  "Buy"  texts.  We  do  not  claim  that  this  result  is  critical  for  our 
theory,  but  rather  only  that  such  findings  are  not  inconsistent  with  it.  The 
two  relevant  fundamentals  changed  from  trial  to  trial  in  the  decision  task. 
The  fact  that  an  advantge  for  "Not  Buy”  texts  was  found  in  a  situation  where 
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the  to  be  considered  fundamentals  were  changing  can  be  viewed  as  evidence  that 
short-term  memory  can  affect  the  application  of  higher-order  knowledge  to  text 
processing*  Heuristics  generated  by  the  control  schema  probably  control  the 
level  of  text  processing.  For  example,  a  given  statement  might  be  processed 
only  to  the  point  of  determining  its  relevancy  to  the  decision  rule.  If  the 
categorized  information  in  a  current  text  statement  is  irrelevant  then  no 
evaluation  analysis  is  necessary. 

This  sort  of  processing  heuristic  could  be  present  in  both  the  RA  and  RB 
groups.  However,  the  difference  in  task  environment  between  these  groups 
produces  differences  in  schema  specialization.  The  rule  in  effect  provides  a 
sharp  criterion  for  relevancy  and  several  experimental  effects  substantiated 
this.  Most  notably,  categorical  information  irrelevant  to  the  rule  affected 
the  RB  condition  less  than  the  RA  condition. 

That  these  effects  were  the  result  of  a  task  adjusted  control  schema  is 
partially  explained  by  analyzing  how  groups  RB  and  RA  processed  texts  in  the 
verification  task.  These  data  show  that  task  relevant  processing,  developed 
in  one  task  apparently  has  somewhat  lasting  effects.  On  this  basis,  we  assume 
that  the  adjustment  in  processing  is  controlled  at  the  knowledge  level  and  not 
merely  at  a  fast  changing  level  such  as  at  the  level  of  short-term  memory. 

Briefly,  it  is  assumed  that  the  task  specific  transfer  effects  found  in 
the  present  study  tend  to  support  the  notion  of  control  schema  as  a  knowledge 
representation  that  operates  to  control  processing  input  by  determining 
information  relevancy.  There  is  no  sufficient  evidence  here  to  allow  an 
assumption  that  analysis  of  relevancy  is  the  only  or  primitive  function  of  a 
control  schema.  It  does,  however,  appear  that  it  could  be  fruitful  to  think 
of  the  schema  as  a  kind  of  ongoing  means-ends  analysis  that  functions  to 
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control  the  depth  of  processing  of  pieces  of  textual  information.  From  the 
data  presented  here  it  is  abundantly  clear  that  some  such  analysis  takes 
place.  It  is  by  no  means  a  new  finding  that  text  processing  is  controlled  in 
part  by  the  readers  Intentions.  Nevertheless,  it  is  useful  to  integrate  this 
into  current  conceptualization  of  executive-type  processes  in  reading  for 
purposes  of  decision  making. 
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Table 


N/Know 


Table  2 

Text  assembled  according  to  design  specification  of 
Trial  2  in  Table  1 


Sales  of  large-scale  data  processing  systems  are  substantial  in 
dollar  terms  and  are  expanding  modestly.  Increased  debt  to  capital 
ratio  severely  reduced  Ectex  cash  position.  Directors  will  meet 
next  month  and  there  is  speculation  about  a  stock  split  of  3  for  I. 


Percent  Correct  Response  for  Various  Conditions  in  the  Decision  Task 


Table  7 

Percent  Correct  Response  in  Conditions  RA  and  RB  for  Probes 
Within  and  Outside  a  Correlated  Pair  of  Categories 

Probe  Type 
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Table  8 

Percent  Correct  Response  for  Consistent  and  Inconsistent  Texts 
and  Within  and  Outside  a  Correlated  Pair 
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Table  9 


Percent  Correct  Positive  and  Negative  Responses 
in  Consistent  and  Inconsistent  Texts 

Response 
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Table  10 

Percent  Correct  Response  for  Different  Probes, 
Conditions  and  Responses 

Rule  Before 


Probe  Type 
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OUTSIDE 


00 

.72 

.77 

.82 

INSIDE 


OUTSIDE 


Rule  After 


.78 

.84 

.73 

.72 

Navy 


Navy 


1  Hr .  Ed  Aiken 

Navy  Personnel  R&D  Center 
San  Diego,  CA  92152 

1  Meryl  S,  Baker 
NPRDC 
Code  P309 

San  Diego,  CA  92152 

1  Dr.  Robert  Breaux 
Code  N-711 
NAVTRAEQUIPCEN 
Orlando,  FL  32813 

1  Dr.  Richard  Elster 

Department  of  Administrative  Sciences 
Naval  Postgraduate  School 
Monterey,  CA  93940 

1  DR.  PAT  FEDERICO 

NAVY  PERSONNEL  R&D  CENTER 
SAN  DIEGO.  CA  92152 

1  Dr .  John  Ford 

Navy  Personnel  R&D  Center 
San  mego,  CA  92152 

1  Dr.  Henry  M.  Halff 

Department  of  Psychology , C-009 
University  of  California  at  San  Diego 
La  Jolla,  CA  92093 

1  LT  Steven  D.  Harris,  MSC,  USN 
Code  6021 

Naval  Air  Development  Center 
Warminster,  Pennsylvania  18974 


1  CDR  Robert  S.  Kennedy 

Head,  Human  Performance  Sciences 
Naval  Aerospace  Medical  Research  Lab 
Box  29407 

New  Orleans,  LA  70189 

1  Dr.  Norman  J.  Kerr 

Chief  of  Naval  Technical  Training 
Naval  Air  Station  Memphis  (75) 
Millington,  TN  38054 

1  Dr.  William  L.  Maloy 

Principal  Civilian  Advisor  for 
Education  and  Training 
Naval  Training  Command,  Code  00A 
Pensacola,  FL  32508 

1  Dr.  Kneale  Marshall 

Scientific  Advisor  to  DCNO(MPT) 

OP01T 

Washington  DC  20370 

1  CAPT  Richard  L.  Martin,  USN 
Prospective  Commanding  Officer 
USS  Carl  Vinson  (CVN-70) 

Newport  News  Shipbuilding  and  Drydock  Co 
Newport  News,  VA  23607 

1  Dr  William  Montague 

Navy  Personnel  R&D  Center 
San  Diego,  CA  92152 

1  Ted  M.  I.  Yellen 

Technical  Information  Office,  Code  201 
NAVY  PERSONNEL  R&D  CENTER 
SAN  DIEGO,  CA  92152 

1  Library,  Code  P201L 

Navy  Personnel  R&D  Center 
San  Diego,  CA  92152 


1  Dr.  Jim  Hollan 
Code  304 

Navy  Personnel  R&D  Center 
San  Diego,  CA  92152 

1  CDR  Charles  W.  Hutchins 

Naval  Air  Systems  Command  Hq 
AIR-340F 
Navy  Department 
Washington,  DC  20361 


1  Technical  Director 

Navy  Personnel  R&D  Center 
San  Diego,  CA  92152 

6  Commanding  Officer 

Naval  Research  Laboratory 
Code  2627 

Washington,  DC  20390 


Navy 


Navy 


1  Psychologist 

ONR  Branch  Office 
Bldg  114,  Section  D 
666  Summer  Street 
Boston,  MA  02210 

1  Psychologist 

ONR  Branch  Office 
536  S.  Clark  Street 
Chicago,  IL  60605 

1  Office  of  Naval  Research 
Code  437 

800  N.  Quincy  SStreet 
Arlington,  VA  22217 

5  Personnel  A  Training  Research  Programs 
(Code  458) 

Office  of  Naval  Research 
Arlington,  VA  22217 

1  Psychologist 

ONR  Branch  Office 
1030  East  Green  Street 
Pasadena,  CA  91101 

1  Special  Asst,  for  Education  and 
Training  (0P-01E) 
ftn.  2705  Arlington  Annex 
Washington,  DC  20370 

1  Office  of  the  Chief  of  Naval  Operations 
Research  Development  &  Studies  Branch 
(OP-115) 

Washington,  DC  20350 

1  Dr.  Donald  F.  Parker 

Graduate  School  of  Business  Administrati 
University  of  Michigan 
Ann  Arbor,  MI  48109 

1  LT  Frank  C.  Petho,  MSC,  USN  (Ph.D) 

Selection  and  Training  Research  Division 
Human  Performance  Sciences  Dept. 

Naval  Aerospace  Medical  Research  Laborat 
Pensacola,  FL  32508 


Dr.  Gary  Poock 

Operations  Research  Department 
Code  55PK 

Naval  Postgraduate  School 
Monterey,  CA  93940 

1  Roger  W.  Remington,  Ph.D 
Code  L52 
NAMRL 

Pensacola,  FL  32508 

1  Dr.  Bernard  Rimland  (03B) 

Navy  Personnel  R&D  Center 
San  Diego,  CA  92152 

Dr.  Worth  Scanland,  Director 
Research,  Development,  Test  &  Evaluation 
N-5 

Naval  Education  and  Training  Command 
NAS,  Pensacola,  FL  32508 

1  Dr.  Robert  G.  Smith 

Office  of  Chief  of  Naval  Operations 
OP-987H 

Washington,  DC  20350 

1  Dr.  Alfred  F.  Smode 

Training  Analysis  &  Evaluation  Group 
(TAEG) 

Dept,  of  the  Navy 
Orlando,  FL  32813 

1  Dr.  Richard  Sorensen 

Navy  Personnel  R&D  Center 
San  Diego,  CA  92152 

1  Roger  Weissinger-Baylon 

Department  of  Administrative  Sciences 
Naval  Postgraduate  School 
Monterey,  CA  93940 

1  Dr.  Robert  Wisher 
Code  309 

Navy  Personnel  R&D  Center 
San  Diego,  CA  92152 


Navy 


Army 


1  Technical  Director 

U.  S.  Army  Research  Institute  for  the 
Behavioral  and  Social  Sciences 
5001  Eisenhower  Avenue 
Alexandria,  VA  22333 

1  Dr.  Beatrice  J.  Farr 

U.  S.  Army  Research  Institute 
5001  Eisenhower  Avenue 
Alexandria,  VA  22333 

1  Dr.  Dexter  Fletcher 

U.S.  Army  Research  Institute 
5001  Eisenhower  Avenue 
Alexandria  ,VA  22333 

1  DR.  FRANK  J.  HARRIS 

U.S.  ARMY  RESEARCH  INSTITUTE 
5001  EISENHOWER  AVENUE 
ALEXANDRIA,  VA  22333 

1  Col  Frank  Hart 

Army  Research  Institute  for  the 
Behavioral  &  Social  Sciences 
5001  Eisenhower  Blvd. 

Alexandria,  VA  22333 

1  Dr .  Michael  Kaplan 

U.S.  ARMY  RESEARCH  INSTITUTE 
5001  EISENHOWER  AVENUE 
ALEXANDRIA,  VA  22333 

1  Dr.  Milton  S.  Katz 

Training  Technical  Area 
U.S.  Army  Research  Institute 
5001  Eisenhower  Avenue 
Alexandria,  VA  22333 

1  Dr.  Harold  F.  O'Neil,  Jr. 

Attn:  PERI-OK 
Army  Research  Institute 
5001  Eisenhower  Avenue 
Alexandria,  VA  22333 

1  Dr.  Robert  Sasmor 

U.  S.  Army  Research  Institute  for  the 
Behavioral  and  Social  Sciences 
5001  Eisenhower  Avenue 
Alexandria,  VA  22333 


Mr  John  H.  Wolfe 
Code  P310 

U.  S.  Navy  Personnel  Research  and 
Development  Center 
San  Diego,  CA  92152 


Marines 


Other  DoD 


H.  William  Greenup 
Education  Advisor  < E03 1 ) 
Education  Center,  MCDEC 
Quantico,  VA  2213*1 

Special  Assistant  for  Marine 
Corps  Matters 
Code  100M 

Office  of  Naval  Research 
800  N.  Quincy  St. 

Arlington,  VA  22217 

DR.  A. L.  SLAFKOSKY 
SCIENTIFIC  ADVISOR  (CODE  RD-1 ) 
HQ,  U.S.  MARINE  CORPS 
WASHINGTON,  DC  20380 


12  Defense  Technical  Information  Center 
Cameron  Station,  Bldg  5 
Alexandria,  VA  2231*1 
Attn:  TC 

1  Dr.  Craig  I.  Fields 

Advanced  Research  Projects  Agency 
1400  Wilson  Blvd. 

Arlington,  VA  22209 

1  Military  Assistant  for  Training  and 
Personnel  Technology 

Office  of  the  Under  Secretary  of  Defense 
for  Research  &  Engineering 
Room  3D  129,  The  Pentagon 
Washington,  DC  20301 

1  DARPA 

1400  Wilson  Blvd . 

Arlington,  VA  22209 


Army 


Air  Force 


1  Dr.  Frederick  Steinheiser 
Dept,  of  Navy 
Chief  of  Naval  Operations 
OP-113 

Washington,  DC  20350 

1  Dr.  Joseph  Ward 

U.S.  Army  Research  Institute 
5001  Eisenhower  Avenue 
Alexandria,  VA  22333 


1  Dr.  Earl  A.  Alluisi 
HO,  AFHRL  ( AFSC) 

Brooks  AFB,  TX  78235 

1  Dr.  Genevieve  Haddad 
Program  Manager 
Life  Sciences  Directorate 
AFOSR 

Bolling  AFB,  DC  20332 

1  Dr.  Marty  Rockway 
Technical  Director 
AFHRL(OT) 

Williams  AFB,  AZ  58224 


2  3700  TCHTW/TTGH  Stop  32 

Sheppard  AFB,  TX  76311 


I 

j 


Civil  Govt 


Non  Govt 


1  Dr.  Susan  Chi pm an 

Learning  and  Development 
National  Institute  of  Education 
1200  19th  Street  NW 
Washington,  DC  20208 

1  William  J.  McLaurin 
66610  Howie  Court 
Camp  Springs,  MD  20031 

1  Dr.  Arthur  Melmed 

National  Intitute  of  Education 
1200  19th  Street  NW 
Washington,  DC  20208 

1  Dr.  Andrew  R.  Molnar 
Science  Education  Dev. 
and  Research 

National  Science  Foundation 
Washington,  DC  20550 

1  Dr.  Joseph  Psotka 

National  Institute  of  Education 
1200  19th  St.  NW 
Washington ,DC  20208 

1  Dr.  Frank  Withrow 

U.  S.  Office  of  Education 
400  Maryland  Ave.  SW 
Washington,  DC  20202 

1  Dr.  Joseph  L.  Young,  Director 
Memory  &  Cognitive  Processes 
National  Science  Foundation 
Washington,  DC  20550 


1  Dr.  John  R.  Anderson 

Department  of  Psychology 
Carnegie  Mellon  University 
Pittsburgh,  PA  15213 

1  Anderson,  Thomas  H. ,  Ph.D. 

Center  for  the  Study  of  Reading 
171*  Children's  Research  Center 
51  Gerty  Drive 
Champiagn,  IL  61820 

1  Dr .  John  Annett 

Department  of  Psychology 
University  of  Warwick 
Coventry  CV4  7AL 
ENGLAND 

1  DR.  MICHAEL  ATWOOD 

SCIENCE  APPLICATIONS  INSTITUTE 
40  DENVER  TECH.  CENTER  WEST 
7935  E.  PRENTICE  AVENUE 
ENGLEWOOD,  CO  80110 

1  1  psychological  research  unit 

Dept,  of  Defense  (Army  Office) 
Campbell  Park  Offices 
Canberra  ACT  2600,  Australia 

1  Dr.  Alan  Baddeley 

Medical  Research  Council 

Applied  Psychology  Unit 
15  Chaucer  Road 
Cambridge  CB2  2EF 
ENGLAND 

1  Dr.  Patricia  Baggett 

Department  of  Psychology 
University  of  Denver 
University  Park 
Denver,  CO  80208 


1  Mr  Avron  Barr 

Department  of  Computer  Science 
Stanford  University 
Stanford,  CA  94305 


Non  Govt 


Non  Govt 


1  CDR  Robert  J.  Biersner 
Program  Manager 
Human  Performance 
Navy  Medical  R&D  Command 
Be  the  3d  a ,  MD  20014 

1  Liaison  Scientists 

Office  of  Naval  Research, 

Branch  Office  ,  London 
Box  39  FPO  New  York  09510 

1  Dr.  Lyle  Bourne 

Department  of  Psychology 
University  of  Colorado 
Boulder,  CO  80309 

1  Dr .  John  S.  Brown 

XEROX  Palo  Alto  Research  Center 
3333  Coyote  Road 
Palo  Alto,  CA  94304 

1  Dr.  Bruce  Buchanan 

Department  of  Computer  Science 
Stanford  University 
Stanford,  CA  94305 

1  DR.  C.  VICTOR  BUNDERSON 
WICAT  INC. 

UNIVERSITY  PLAZA,  SUITE  10 
1160  SO.  STATE  ST. 

OREM,  UT  84057 

1  Dr .  Pat  Carpenter 

Department  of  Psychology 
Carnegie-Mellon  University 
Pittsburgh,  PA  15213 


1  Dr.  William  Chase 

Department  of  Psychology 
Carnegie  Mellon  University 
Pittsburgh,  PA  15213 

1  Dr.  Michel ine  Chi 

Learning  R&D  Center 
University  of  Pittsburgh 
3939  O'Hara  Street 
Pittsburgh,  PA  15213 

1  Dr.  William  Clancey 

Department  of  Computer  Science 
Stanford  University 
Stanford,  CA  94305 

1  Dr.  Allan  M.  Collins 

Bolt  Beranek  &  Newman,  Inc. 

50  Moulton  Street 
Cambridge,  Ma  02138 

1  Dr.  Lynn  A.  Cooper 
LRDC 

University  of  Pittsburgh 
3939  O'Hara  Street 
Pittsburgh.  PA  15213 

1  Dr.  Meredith  P.  Crawford 

American  Psychological  Association 
1200  17th  Street,  N.W. 

Washington,  DC  20036 

1  Dr .  Kenneth  B.  Cross 
Anacapa  Sciences,  Inc. 

P.0.  Drawer  0 

Santa  Barbara,  CA  93102 


1  Dr.  John  B.  Carroll  1  Dr.  Ronna  Dillon 

Psychometric  Lab  Department  of  Guidance  and  Educational  P 

Univ.  of  No.  Carolina  Southern  Illinois  University 

Davie  Hall  01 3A  Carbondale,  IL  62901 

Chapel  Hill,  NC  27514 

1  Dr.  Hubert  Dreyfus 

1  Charles  Myers  Library  Department  of  Philosophy 

Livingstone  House  University  of  California 

Livingstone  Road  Berkely,  CA  94720 

Stratford 
London  E15  2LJ 


Non  Govt  Non  Govt 

LCOL  J.  C.  Eggenberger  1  Dr.  Daniel  Gopher 

DIRECTORATE  OF  PERSONNEL  APPLIED  RESEARC  Industrial  &  Management  Engineering 


NATIONAL  DEFENCE  HQ 
101  COLONEL  BY  DRIVE 
OTTAWA,  CANADA  K1A  0K2 

1  Dr .  Ed  Feigenbaum 

Department  of  Computer  Science 
Stanford  University 
Stanford,  CA  94305 

1  Dr.  Richard  L.  Ferguson 

The  American  College  Testing  Program 

P.0.  Box  168 

Iowa  City,  IA  52240 

1  Mr.  Wallace  Feurzeig 

Bolt  Beranek  A  Newman,  Inc. 

50  Moulton  St. 

Cambridge,  MA  02138 

1  Dr.  Victor  Fields 
Dept,  of  Psychology 
Montgomery  College 
Rockville,  MD  20850 

1  Dr.  John  R.  Frederiksen 
Bolt  Beranek  &  Newman 
50  Moulton  Street 
Cambridge,  MA  02138 

1  Dr.  Alinda  Friedman 

Department  of  Psychology 
University  of  Alberta 
Edmonton,  Alberta 
CANADA  T6G  2E9 

1  DR.  ROBERT  GLASER 
LRDC 

UNIVERSITY  OF  PITTSBURGH 
3939  O'HARA  STREET 
PITTSBURGH,  PA  15213 

1  Dr.  Marvin  D.  Glock 
217  Stone  Hall 
Cornell  University 
Ithaca,  NY  14853 


Technion-Israel  Institute  of  Technology 

Haifa 

ISRAEL 

1  DR.  JAMES  G.  GREEN0 
LRDC 

UNIVERSITY  OF  PITTSBURGH 
3939  O'HARA  STREET 
PITTSBURGH,  PA  15213 

1  Dr.  Harold  Hawkins 

Department  of  Psychology 
University  of  Oregon 
Eugene  OR  97403 

1  Dr.  Barbara  Hayes-Roth 
The  Rand  Corporation 
1700  Main  Street 
Santa  Monica,  CA  90406 

1  Dr.  Frederick  Hayes-Roth 
The  Rand  Corporation 
1700  Main  Street 
Santa  Monica,  CA  90406 

1  Dr.  James  R.  Hoffman 

Department  of  Psychology 
University  of  Delaware 
Newark,  DE  19711 

1  Glenda  Greenwald,  Ed. 

"Human  Intelligence  Newsletter" 

P.  0.  Box  1163 
Birmingham,  MI  48012 

1  Dr .  Earl  Hunt 

Dept,  of  Psychology 
University  of  Washington 
Seattle,  WA  98105 

1  Dr.  Greg  Kearsley 
HumRRO 

300  N.  Washington  Street 
Alexandria,  VA  22314 


Non  Govt 


Non  Govt 


Dr.  Walter  Kintsch  1 

Department  of  Psychology 
University  of  Colorado 
Boulder,  CO  80 302 

Dr.  David  Kieras  1 

Department  of  Psychology 
University  of  Arizona 
Tuscon,  AZ  85721 

Dr.  Kenneth  A.  Klivington  1 

Program  Officer 

Alfred  P.  Sloan  Foundation 

630  Fifth  Avenue 

New  York,  NY  10111 

1 

Dr.  Stephen  Kosslyn 
Harvard  University 
Department  of  Psychology 
33  Kirkland  Street 
Cambridge,  MA  02138 

1 

Dr.  Jill  Larkin 
Department  of  Psychology 
Carnegie  Mellon  University 
Pittsburgh,  PA  15213 

1 

Dr.  Alan  Lesgold 

Learning  R&D  Center 

University  of  Pittsburgh 

Pittsburgh,  PA  15260  1 

Dr.  Charles  Lewis 

Faculteit  Sociale  Wetenschappen 

Ri jksuniversiteit  Groningen 

Oude  Botering estraat  23  1 

9712GC  Groningen 

Netherlands 

Dr.  Erik  McWilliams 

Science  Education  Dev.  and  Research  1 

National  Science  Foundation 
Washington,  DC  20550 

Dr.  Mark  Miller 
TI  Computer  Science  Lab 
C/0  2824  Winterplace  Circle 
Plano,  TX  75075 


Dr.  Allen  Munro 

Behavioral  Technology  Laboratories 
1845  Elena  Ave.,  Fourth  Floor 
Redondo  Beach,  CA  90277 

Dr .  Donald  A  Norman 
Dept,  of  Psychology  C-009 
Univ.  of  California,  San  Diego 
La  Jolla,  CA  92093 

Dr  .  Jesse  Orlansky 
Institute  for  Defense  Analyses 
400  Army  Navy  Drive 
Arlington,  VA  22202 

Dr.  Seymour  A.  Papert 
Massachusetts  Institute  of  Technology 
Artificial  Intelligence  Lab 
545  Technology  Square 
Cambridge,  MA  02139 

Dr.  James  A.  Paulson 
Portland  State  University 
P.0.  Box  751 
Portland,  OR  97207 

MR.  LUIGI  PETRULLO 
2431  N.  EDGEWOOD  STREET 
ARLINGTON ,  VA  22207 

DR.  PETER  POLSON 
DEPT.  OF  PSYCHOLOGY 
UNIVERSITY  OF  COLORADO 
BOULDER,  CO  80 309 

Dr.  Steven  E.  Poltrock 
Department  of  Psychology 
University  of  Denver 
Denver, CO  80208 

MINRAT  M.  L.  RAUCH 
P  II  4 

BUNDESMINISTERIUM  DER  VERTEIDIGUNG 

P0STFACH  1328 

D-53  BONN  1,  GERMANY 


Non  Govt 


Non  Govt 


Dr.  Fred  Re  if 
SESAME 

c/o  Physics  Department 
University  of  California 
Berkely,  CA  94720 

Dr.  Lauren  Resnick 
LRDC 

University  of  Pittsburgh 
3939  O'Hara  Street 
Pittsburgh,  PA  15213 

Mary  Riley 
LRDC 

University  of  Pittsburgh 
3939  O'Hara  Street 
Pittsburgh,  PA  15213 

Dr.  Andrew  M.  Rose 
American  Institutes  for  Research 
1055  Thomas  Jefferson  St .  NW 
Washington,  DC  20007 

Dr.  Ernst  Z.  Rothkopf 
Bell  Laboratories 
600  Mountain  Avenue 
Murray  Hill,  NJ  07974 

Dr.  David  Rumelhart 

Center  for  Human  Information  Processing 
Univ.  of  California,  San  Diego 
La  Jolla,  CA  92093 

DR.  WALTER  SCHNEIDER 
DEPT.  OF  PSYCHOLOGY 
UNIVERSITY  OF  ILLINOIS 
CHAMPAIGN,  IL  61820 

Dr.  Alan  Schoenfeld 
Department  of  Mathematics 
Hamilton  College 
Clinton,  NY  13323 

DR.  ROBERT  J.  SEIDEL 
INSTRUCTIONAL  TECHNOLOGY  GROUP 
HUMRR0 

300  N.  WASHINGTON  ST. 

ALEXANDRIA,  VA  22314 


1  Committee  on  Cognitive  Research 
%  Dr.  Lonnie  R.  Sherrod 
Social  Science  Research  Council 
605  Third  Avenue 
New  York,  NY  10016 

1  Dr.  Alexander  W.  Siegel 
Department  of  Psychology 
SR-1 

University  of  Houston 
Houston ,  TX  77004 

1  Robert  S.  Siegler 
Associate  Professor 
Carnegie-Mellon  University 
Department  of  Psychology 
Schenley  Park 
Pittsburgh,  PA  15213 

1  Dr.  Edward  E.  Smith 

Bolt  Beranek  &  Newman,  Inc. 

50  Moulton  Street 
Cambridge,  MA  02138 

1  Dr.  Robert  Smith 

Department  of  Computer  Science 

Rutgers  University 

New  Brunswick,  NJ  08903 

1  Dr.  Richard  Snow 

School  of  Education 
Stanford  University 
Stanford,  CA  94305 

1  Dr .  Robert  Sternberg 
Dept,  of  Psychology 
Yale  University 
Box  11A,  Yale  Station 
New  Haven,  CT  06520 

1  DR.  ALBERT  STEVENS 

BOLT  BERANEK  &  NEWMAN,  INC. 

50  MOULTON  STREET 
CAMBRIDGE,  MA  02138 


Dr.  Thomas  G.  Sticht 

Director,  Basic  Skills  Division 

HUMRRO 

300  N.  Washington  Street 
Alexandria ,VA  22 314 

David  E.  Stone,  Ph.D. 

Hazeltine  Corporation 
7680  Old  Springhouse  Road 
McLean,  VA  22102 

DR.  PATRICK  SUPPES 

INSTITUTE  FOR  MATHEMATICAL  STUDIES  IN 
THE  SOCIAL  SCIENCES 
STANFORD  UNIVERSITY 
STANFORD,  CA  94305 

Dr.  Kikumi  Tatsuoka 
Computer  Based  Education  Research 
Laboratory 

252  Engineering  Research  Laboratory 
University  of  Illinois 
Urbana,  IL  61801 

Dr.  Douglas  Towne 
Univ.  of  So.  California 
Behavioral  Technology  Labs 
1845  S.  Elena  Ave. 

Redondo  Beach,  CA  90277 

Dr  .  J .  Uhl aner 
Perceptronics,  Inc. 

6271  Variel  Avenue 
Woodland  Hills,  CA  91364 

DR.  GERSHON  WELTMAN 
PERCEPTRONICS  INC. 

6271  VARIEL  AVE. 

WOODLAND  HILLS,  CA  91367 

Dr.  Keith  T.  Wescourt 
Information  Sciences  Dept. 

The  Rand  Corporation 
1700  Main  St. 


END 

DATE 

FILMED 


DTIC 


